Pandas Profiling Report

Dataset statistics

Number of variables	9
Number of observations	117221
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	8.0 MiB
Average record size in memory	72.0 B

Variable types

Numeric	9

Alerts

`df_index` is highly overall correlated with `year`	High correlation
`year` is highly overall correlated with `df_index`	High correlation
`cr_num` is highly overall correlated with `district`	High correlation
`district` is highly overall correlated with `cr_num`	High correlation
`soil_moisture_min` is highly overall correlated with `soil_moisture_mean`	High correlation
`soil_moisture_max` is highly overall correlated with `soil_moisture_mean`	High correlation
`soil_moisture_mean` is highly overall correlated with `soil_moisture_min` and 1 other fields	High correlation
`df_index` is uniformly distributed	Uniform
`df_index` has unique values	Unique
`cr_num` has 3852 (3.3%) zeros	Zeros

Reproduction

Analysis started	2023-07-04 03:00:23.991730
Analysis finished	2023-07-04 03:00:33.398804
Duration	9.41 seconds
Software version	pandas-profiling v3.6.6
Download configuration	config.json

df_index
Real number (ℝ)

HIGH CORRELATION UNIFORM UNIQUE

Distinct	117221
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	58610

Minimum	0
Maximum	117220
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	0
5-th percentile	5861
Q1	29305
median	58610
Q3	87915
95-th percentile	111359
Maximum	117220
Range	117220
Interquartile range (IQR)	58610

Descriptive statistics

Standard deviation	33838.932
Coefficient of variation (CV)	0.57735766
Kurtosis	-1.2
Mean	58610
Median Absolute Deviation (MAD)	29305
Skewness	7.9260761 × 10^-17
Sum	6.8703228 × 10⁹
Variance	1.1450733 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
80166	1	< 0.1%
80164	1	< 0.1%
80163	1	< 0.1%
80161	1	< 0.1%
80160	1	< 0.1%
80159	1	< 0.1%
80158	1	< 0.1%
80157	1	< 0.1%
80156	1	< 0.1%
Other values (117211)	117211	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
117220	1	< 0.1%
117219	1	< 0.1%
117218	1	< 0.1%
117217	1	< 0.1%
117216	1	< 0.1%
117215	1	< 0.1%
117214	1	< 0.1%
117213	1	< 0.1%
117212	1	< 0.1%
117211	1	< 0.1%

year
Real number (ℝ)

Distinct	17
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1998.7549

Minimum	1978
Maximum	2017
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	1978
5-th percentile	1983
Q1	1991
median	1997
Q3	2011
95-th percentile	2017
Maximum	2017
Range	39
Interquartile range (IQR)	20

Descriptive statistics

Standard deviation	11.788816
Coefficient of variation (CV)	0.00589808
Kurtosis	-1.2228741
Mean	1998.7549
Median Absolute Deviation (MAD)	11
Skewness	0.31329389
Sum	2.3429605 × 10⁸
Variance	138.97619
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=17)

Value	Count	Frequency (%)
1999	9823	8.4%
1998	9801	8.4%
1997	9510	8.1%
2016	9320	8.0%
1992	9143	7.8%
2015	9081	7.7%
2011	8845	7.5%
2017	8657	7.4%
1993	7075	6.0%
1991	6456	5.5%
Other values (7)	29510	25.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1978	559	0.5%
1982	4874	4.2%
1983	5226	4.5%
1984	4886	4.2%
1985	4958	4.2%
1986	5195	4.4%
1991	6456	5.5%
1992	9143	7.8%
1993	7075	6.0%
1994	3812	3.3%

Value	Count	Frequency (%)
2017	8657	7.4%
2016	9320	8.0%
2015	9081	7.7%
2011	8845	7.5%
1999	9823	8.4%
1998	9801	8.4%
1997	9510	8.1%
1994	3812	3.3%
1993	7075	6.0%
1992	9143	7.8%

month
Real number (ℝ)

Distinct	12
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.2727412

Minimum	1
Maximum	12
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	1
5-th percentile	4
Q1	5
median	7
Q3	9
95-th percentile	11
Maximum	12
Range	11
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.4542377
Coefficient of variation (CV)	0.33745703
Kurtosis	-0.80117132
Mean	7.2727412
Median Absolute Deviation (MAD)	2
Skewness	-0.067768112
Sum	852518
Variance	6.0232826
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
7	15140	12.9%
5	14861	12.7%
8	14810	12.6%
9	14788	12.6%
6	14540	12.4%
10	13561	11.6%
4	11745	10.0%
11	9000	7.7%
3	3779	3.2%
12	3138	2.7%
Other values (2)	1859	1.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	880	0.8%
2	979	0.8%
3	3779	3.2%
4	11745	10.0%
5	14861	12.7%
6	14540	12.4%
7	15140	12.9%
8	14810	12.6%
9	14788	12.6%
10	13561	11.6%

Value	Count	Frequency (%)
12	3138	2.7%
11	9000	7.7%
10	13561	11.6%
9	14788	12.6%
8	14810	12.6%
7	15140	12.9%
6	14540	12.4%
5	14861	12.7%
4	11745	10.0%
3	3779	3.2%

day
Real number (ℝ)

Distinct	31
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15.879313

Minimum	1
Maximum	31
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	8
median	16
Q3	24
95-th percentile	30
Maximum	31
Range	30
Interquartile range (IQR)	16

Descriptive statistics

Standard deviation	8.847425
Coefficient of variation (CV)	0.55716672
Kurtosis	-1.2057331
Mean	15.879313
Median Absolute Deviation (MAD)	8
Skewness	-0.0094467519
Sum	1861389
Variance	78.276929
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
25	4060	3.5%
26	4012	3.4%
29	3976	3.4%
27	3945	3.4%
23	3916	3.3%
16	3904	3.3%
13	3887	3.3%
10	3878	3.3%
11	3878	3.3%
12	3866	3.3%
Other values (21)	77899	66.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	3851	3.3%
2	3720	3.2%
3	3834	3.3%
4	3820	3.3%
5	3833	3.3%
6	3739	3.2%
7	3785	3.2%
8	3745	3.2%
9	3689	3.1%
10	3878	3.3%

Value	Count	Frequency (%)
31	2241	1.9%
30	3827	3.3%
29	3976	3.4%
28	3842	3.3%
27	3945	3.4%
26	4012	3.4%
25	4060	3.5%
24	3863	3.3%
23	3916	3.3%
22	3735	3.2%

cr_num
Real number (ℝ)

HIGH CORRELATION ZEROS

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5.2548861

Minimum	0
Maximum	10
Zeros	3852
Zeros (%)	3.3%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	3
median	5
Q3	7
95-th percentile	10
Maximum	10
Range	10
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.7631007
Coefficient of variation (CV)	0.52581553
Kurtosis	-0.93618946
Mean	5.2548861
Median Absolute Deviation (MAD)	2
Skewness	-0.080872823
Sum	615983
Variance	7.6347254
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
7	14465	12.3%
5	14370	12.3%
6	13997	11.9%
4	13702	11.7%
8	10932	9.3%
1	10832	9.2%
3	10643	9.1%
9	9065	7.7%
10	7695	6.6%
2	7668	6.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	3852	3.3%
1	10832	9.2%
2	7668	6.5%
3	10643	9.1%
4	13702	11.7%
5	14370	12.3%
6	13997	11.9%
7	14465	12.3%
8	10932	9.3%
9	9065	7.7%

Value	Count	Frequency (%)
10	7695	6.6%
9	9065	7.7%
8	10932	9.3%
7	14465	12.3%
6	13997	11.9%
5	14370	12.3%
4	13702	11.7%
3	10643	9.1%
2	7668	6.5%
1	10832	9.2%

district
Real number (ℝ)

Distinct	39
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4730.5855

Minimum	4601
Maximum	4870
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	4601
5-th percentile	4603
Q1	4612
median	4741
Q3	4791
95-th percentile	4860
Maximum	4870
Range	269
Interquartile range (IQR)	179

Descriptive statistics

Standard deviation	87.887526
Coefficient of variation (CV)	0.018578572
Kurtosis	-1.1830538
Mean	4730.5855
Median Absolute Deviation (MAD)	69
Skewness	-0.25589119
Sum	5.5452396 × 10⁸
Variance	7724.2172
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=39)

Value	Count	Frequency (%)
4840	5808	5.0%
4870	3875	3.3%
4612	3852	3.3%
4860	3820	3.3%
4830	3751	3.2%
4820	3637	3.1%
4810	3544	3.0%
4850	3257	2.8%
4790	3175	2.7%
4740	2997	2.6%
Other values (29)	79505	67.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
4601	2657	2.3%
4602	2686	2.3%
4603	2626	2.2%
4604	2464	2.1%
4605	2523	2.2%
4606	2681	2.3%
4607	2808	2.4%
4608	2674	2.3%
4609	2666	2.3%
4610	2852	2.4%

Value	Count	Frequency (%)
4870	3875	3.3%
4860	3820	3.3%
4850	3257	2.8%
4840	5808	5.0%
4830	3751	3.2%
4820	3637	3.1%
4810	3544	3.0%
4791	2911	2.5%
4790	3175	2.7%
4781	2647	2.3%

soil_moisture_min
Real number (ℝ)

Distinct	114629
Distinct (%)	97.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.16165965

Minimum	0
Maximum	0.64574057
Zeros	123
Zeros (%)	0.1%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	0
5-th percentile	0.096687213
Q1	0.12938167
median	0.15652949
Q3	0.18990871
95-th percentile	0.24168602
Maximum	0.64574057
Range	0.64574057
Interquartile range (IQR)	0.060527042

Descriptive statistics

Standard deviation	0.045153557
Coefficient of variation (CV)	0.27931247
Kurtosis	0.98062917
Mean	0.16165965
Median Absolute Deviation (MAD)	0.029800057
Skewness	0.59812647
Sum	18949.906
Variance	0.0020388437
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	123	0.1%
0.08241999894	19	< 0.1%
0.1087899953	18	< 0.1%
0.090640001	17	< 0.1%
0.07685999572	17	< 0.1%
0.07482999563	15	< 0.1%
0.1005899981	15	< 0.1%
0.07521999627	14	< 0.1%
0.08415000141	14	< 0.1%
0.08810000122	13	< 0.1%
Other values (114619)	116956	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	123	0.1%
0.001210424467	1	< 0.1%
0.002227913588	1	< 0.1%
0.003510870039	1	< 0.1%
0.005049052183	1	< 0.1%
0.009607681073	1	< 0.1%
0.01146424375	1	< 0.1%
0.01209984161	1	< 0.1%
0.01422919892	1	< 0.1%
0.01498914883	1	< 0.1%

Value	Count	Frequency (%)
0.6457405686	1	< 0.1%
0.5618879199	1	< 0.1%
0.5259379745	1	< 0.1%
0.5016546845	1	< 0.1%
0.4543149173	1	< 0.1%
0.452249974	1	< 0.1%
0.4516600072	1	< 0.1%
0.4365988672	1	< 0.1%
0.4365700185	1	< 0.1%
0.4353488088	1	< 0.1%

soil_moisture_max
Real number (ℝ)

Distinct	115117
Distinct (%)	98.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.2663669

Minimum	0
Maximum	1
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	0
5-th percentile	0.1718033
Q1	0.22146627
median	0.26009038
Q3	0.30534714
95-th percentile	0.38160306
Maximum	1
Range	1
Interquartile range (IQR)	0.083880872

Descriptive statistics

Standard deviation	0.063959205
Coefficient of variation (CV)	0.24011694
Kurtosis	1.6882324
Mean	0.2663669
Median Absolute Deviation (MAD)	0.041546434
Skewness	0.64726641
Sum	31223.794
Variance	0.0040907799
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.4679999948	89	0.1%
0.1673100144	9	< 0.1%
0.4390000105	9	< 0.1%
0.2333600074	9	< 0.1%
0.3050799966	8	< 0.1%
0.3491100073	7	< 0.1%
0.4331700206	7	< 0.1%
1	6	< 0.1%
0.452249974	6	< 0.1%
0.3685699701	6	< 0.1%
Other values (115107)	117065	99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
0.04361159354	1	< 0.1%
0.05770999938	1	< 0.1%
0.07018999755	1	< 0.1%
0.07067909092	1	< 0.1%
0.07183000445	1	< 0.1%
0.07389040291	1	< 0.1%
0.07664000243	1	< 0.1%
0.07676000148	1	< 0.1%
0.07722999901	1	< 0.1%

Value	Count	Frequency (%)
1	6	< 0.1%
0.8029572368	1	< 0.1%
0.7982676029	1	< 0.1%
0.7946008444	1	< 0.1%
0.7860453129	1	< 0.1%
0.7845153213	1	< 0.1%
0.7719236016	1	< 0.1%
0.7685557008	1	< 0.1%
0.7459300756	1	< 0.1%
0.7408373356	1	< 0.1%

soil_moisture_mean
Real number (ℝ)

Distinct	117189
Distinct (%)	> 99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.20791962

Minimum	0
Maximum	0.64574057
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	915.9 KiB

Quantile statistics

Minimum	0
5-th percentile	0.14314213
Q1	0.17573811
median	0.2041316
Q3	0.2366064
95-th percentile	0.28421264
Maximum	0.64574057
Range	0.64574057
Interquartile range (IQR)	0.060868291

Descriptive statistics

Standard deviation	0.043866671
Coefficient of variation (CV)	0.21097899
Kurtosis	0.37925091
Mean	0.20791962
Median Absolute Deviation (MAD)	0.030183053
Skewness	0.48451513
Sum	24372.545
Variance	0.0019242849
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.2815699875	4	< 0.1%
0.2452364564	2	< 0.1%
0.1660926491	2	< 0.1%
0.2556999922	2	< 0.1%
0.1479144692	2	< 0.1%
0.1952497363	2	< 0.1%
0.1729080379	2	< 0.1%
0.2189272493	2	< 0.1%
0.2862062156	2	< 0.1%
0.1679622829	2	< 0.1%
Other values (117179)	117199	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
0.04361159354	1	< 0.1%
0.05770999938	1	< 0.1%
0.07018999755	1	< 0.1%
0.07067909092	1	< 0.1%
0.07183000445	1	< 0.1%
0.07389040291	1	< 0.1%
0.07664000243	1	< 0.1%
0.07676000148	1	< 0.1%
0.07722999901	1	< 0.1%

Value	Count	Frequency (%)
0.6457405686	1	< 0.1%
0.5618879199	1	< 0.1%
0.5259379745	1	< 0.1%
0.5016546845	1	< 0.1%
0.4543149173	1	< 0.1%
0.452249974	1	< 0.1%
0.4516600072	1	< 0.1%
0.4437993914	1	< 0.1%
0.4414606132	1	< 0.1%
0.4365988672	1	< 0.1%

Auto

Heatmap
Table

	df_index	year	month	day	cr_num	district	soil_moisture_min	soil_moisture_max	soil_moisture_mean
df_index	1.000	0.998	0.017	-0.002	-0.056	-0.060	0.174	-0.034	0.070
year	0.998	1.000	-0.048	-0.003	-0.054	-0.059	0.190	-0.018	0.090
month	0.017	-0.048	1.000	-0.106	-0.028	-0.024	-0.235	-0.238	-0.300
day	-0.002	-0.003	-0.106	1.000	0.000	0.000	-0.005	-0.001	-0.003
cr_num	-0.056	-0.054	-0.028	0.000	1.000	0.951	-0.210	-0.037	-0.169
district	-0.060	-0.059	-0.024	0.000	0.951	1.000	-0.208	0.047	-0.104
soil_moisture_min	0.174	0.190	-0.235	-0.005	-0.210	-0.208	1.000	0.395	0.767
soil_moisture_max	-0.034	-0.018	-0.238	-0.001	-0.037	0.047	0.395	1.000	0.830
soil_moisture_mean	0.070	0.090	-0.300	-0.003	-0.169	-0.104	0.767	0.830	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	df_index	year	month	day	cr_num	district	soil_moisture_min	soil_moisture_max	soil_moisture_mean
0	0	1978	11	1	0	4612	0.165900	0.418710	0.237053
1	1	1978	11	1	5	4740	0.127140	0.207248	0.163722
2	2	1978	11	1	5	4741	0.153398	0.215304	0.170989
3	3	1978	11	1	7	4770	0.140772	0.186390	0.152211
4	4	1978	11	1	7	4771	0.116810	0.116810	0.116810
5	5	1978	11	1	7	4791	0.220273	0.220273	0.220273
6	6	1978	11	1	8	4810	0.101490	0.287831	0.180286
7	7	1978	11	1	8	4820	0.135791	0.281093	0.186174
8	8	1978	11	1	8	4830	0.144074	0.288050	0.193872
9	9	1978	11	1	9	4840	0.125757	0.227233	0.165919

	df_index	year	month	day	cr_num	district	soil_moisture_min	soil_moisture_max	soil_moisture_mean
117211	116816	2017	10	21	9	4840	0.203000	0.250636	0.226508
117212	116841	2017	10	22	9	4840	0.221813	0.225997	0.223948
117213	116869	2017	10	23	9	4840	0.189007	0.257002	0.215051
117214	116889	2017	10	24	9	4840	0.221789	0.262952	0.236139
117215	116911	2017	10	25	9	4840	0.196322	0.256364	0.220181
117216	116938	2017	10	26	9	4840	0.191339	0.271052	0.220148
117217	116957	2017	10	27	9	4840	0.251481	0.251481	0.251481
117218	116976	2017	10	28	9	4840	0.193165	0.267507	0.223290
117219	117003	2017	10	29	9	4840	0.191507	0.243024	0.208214
117220	117033	2017	11	1	9	4840	0.203048	0.214118	0.208583

Overview

Variables

Interactions

Correlations

Missing values

Sample